A Modular Computer Vision Sonification Model for the Visually Impaired
نویسندگان
چکیده
This paper presents a Modular Computer Vision Sonification Model which is a general framework for acquisition, exploration and sonification of visual information to support visually impaired people. The model exploits techniques from Computer Vision and aims to convey as much information as possible about the image to the user, including color, edges and what we refer to as Orientation maps and Micro-Textures. We deliberatively focus on low level features to provide a very general image analysis tool. Our sonification approach relies on MIDI using “real-world” instead of synthetic instruments. The goal is to provide direct perceptual access to images or environments actively and in real time. Our system is already in use, at an experimental stage, at a local residential school, helping congenital blind children develop various cognitive abilities such as geometric understanding and spatial sense as well as offering an intuitive approach to colors and textures.
منابع مشابه
WebSound: a generic Web sonification tool, and its application to an auditory Web browser for blind and visually impaired users
The inherent visual nature of Internet browsers makes the Web inaccessible to the visually impaired. Although several nonvisual browsers have been developed, they usually transform the visual content of HTML documents into textual information only, that can be rendered by a text-to-speech converter or a Braille device. The loss of spatial layout and of textual attributes should be avoided since...
متن کاملA Stereo Image Processing System for Visually Impaired
This paper presents a review on vision aided systems and proposes an approach for visual rehabilitation using stereo vision technology. The proposed system utilizes stereo vision, image processing methodology and a sonification procedure to support blind navigation. The developed system includes a wearable computer, stereo cameras as vision sensor and stereo earphones, all moulded in a helmet. ...
متن کاملWearable Real-Time Stereo Vision for the Visually Impaired
Visually impaired find their navigation difficult as they often lack the needed information for bypassing obstacles and hazards. Electronic Travel Aids (ETAs) are devices that use sensor technology to assist and improve the blind user’s mobility in terms of safety and speed. Modern ETAs does not provide distance information directly and clearly. This paper proposes a method for determining dist...
متن کاملObject Discrimination Using Stereo Vision for Blind through Stereo Sonification
In this paper, a development of image processing, stereovision methodology and a sonification procedure for image sonification system for vision substitution are presented. The hardware part consists of a sunglass fitted with two mini cameras, laptop computer and stereo earphones. The image of the scene in front of blind people is captured by stereo cameras. The captured image is processed to e...
متن کاملRole of Object Identification in sonification System for Visually Impaired
In this paper the role of object identification in sanification system for Navigation Assistance Visually Impaired (NAVI) is discussed. The developed system includes Single Board Processing System (SBPS), vision sensor mounted headgear and stereo earphones. The vision sensor captures the vision information in front of blind user. The captured image is processed to identify the object in the ima...
متن کامل